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ABSTRACT 



The multivariable relationship between interviewer 



predictions of future career plans of applicants to medical school and 
students' characteristics at the time of their interviews was studied. The 
study also sought to determine the multivariable relationship between 
students’ stated career plans at graduation and their characteristics at the 
time of the admissions interview. Variables that described the 
characteristics of applications who ultimately became members of the entering 
classes of 1990, 1991, 1992, and 1993 were obtained from student records. 
Thirteen members of the admissions committee reviewed one-page summaries of 
these variables for these students and predicted their career plans at 
graduation. Graduates of the classes of 1994, 1995, 1996, and 1997 who were 
entering the generalist residency programs of Family Medicine, Internal 
Medicine, and Pediatrics were surveyed regarding their career plans and then 
classified as pursuing a generalist career or not. Logistic regression was 
used to describe the relationships between the interviewer's predictions and 
applicants' characteristics and the relationships between students' career 
plans at graduation and their characteristics at their interviews. Of the 509 
graduates for whom there were complete data, 189 had generalist plans at 
graduation. Interviewers' predictions of generalist career plans were 
significantly related to rural legal residence, lower science grade point 
average, lower parents' educational degree, and a high level of service 
involvement. The two variables with a significant empirical relation to 
student generalist plans at graduation were female gender and a high level of 
service involvement. Results show that academic performance at the time of 
the interview was not related to generalist career plans. (Contains 1 table 
and 19 references.) (SLD) 
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ABSTRACT 

Bacl^round: In an effort to admit more students inclined to select generalist careers, admissions 
committee interviewers at the University of Virginia (UVa) School of Medicine were asked to 
predict which applicants would be “most likely” to pursue generalist careers. It was not clear, 
however, which applicant characteristics were utilized to make these predictions. 

The objective of this study was to determine the multivariable relationship between 
interviewer predictions of future career plans and student characteristics at the time of the 
interview. In addition, this study sought to determine the multivariable relationship between 
students’ stated career plans at graduation and their characteristics at the time of the interview. 
Methods: Variables that described the characteristics of applicants who ultimately became a 
member of the entering class of 1990, 1991, 1992, or 1993 were obtained from student 
records. Thirteen members of the 1997-1998 admissions committee volunteered to review one- 
page summaries of these variables for individual and to make a prediction of student career plans 
at graduation based on this information. Graduates in the Classes of 1994, 1995, 1996, and 1997 
who were entering the generalist residency programs of Family Medicine, Internal Medicine, and 
Pediatrics were surveyed individually regarding their career plans and were classified as pursing 
or not pursing a generalist career. All other graduates entering residency programs were 
classified as not pursing a generalist career. 

Logistic regression was utilized to describe the relationships between interviewers’ predictions 
and applicants’ characteristics as well as the relationships between students’ career plans at 
graduation and their characteristics at the medical school interview. An alpha level of .05 was set 
for the significance level. 

Results: Five hundred and nine graduates (n=509) had complete data for analysis. One hundred 
and eighty-nine (36.5%) had indicated generalist career plans at graduation, and the remaining 
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three hundred and twenty-three (63.5%) had indicated subspecialty career plans. Interviewers’ 
predictions of generalist career plans were significantly related to rural legal residence (p=.02), 
lower science grade point average (p=.003), lower parents’ educational degree level (p=.008), and 
a high level of service involvement (p=.001). The two variables with a significant empirical 
relation to student generalist career plans at graduation were female gender (p=.004) and a high 
level of service involvement (p=.04). 

Conclusions: Admissions committee members predictions of generalist career choice were 
associated with rural legal residence, lower science grade point average, lower parents’ 
educational degree level, and a high level of service involvement. However, only female gender 
and a high level of service involvement were significantly associated with student generalist 
career plans at graduation. The results of this study revealed that academic performance at the 
time of the medical school interview was not related to generalist career plans for graduates at the 
University of Virginia School of Medicine. These findings were reassuring that there is no need 
to compromise on academic quality as a result of seeking applicants who appear to be 
predisposed to a generalist career. It will be important to educate members of the admissions 
committee concerning these findings. 



Introduction 



The 1992 report by the Council on Graduate Medical Education (COGME) entitled Improving 
Access to Health Care Through Physician Workforce Reform: Directions for the 21^ Century 
outlined our nation’s need for an increase in the number of primary care physicians.' Over the 
previous two decades, the number of graduates entering primary care specialties had steadily 
decreased. This trend was considered a major factor in the increased cost of medical care and the 
inadequate provision of health and medical care in some underserved areas.^ Simultaneously, 
managed care delivery systems were penetrating the health care market, with the goal of 
providing cost-effective and high-quality medical care that could be best obtained by increasing 
the primary care physician workforce.^ 

One of the recommendations intended to increase the number of primary care physicians was 
for medical schools to examine their admissions practices with the goal of admitting more 
students inclined to select primary care careers (family practice, general internal medicine, and 
general pediatrics). This approach also was recommended by the Association of American 
Medical Colleges, The American Medical Association, and the Institute of Medicine.^"’ The role 
and possible effects of medical schools’ admission policies on increasing the number of primary 
care physicians have been discussed by a number of writers and researchers.*”" Several studies 
have explored the characteristics of those who subsequently enter a primary care career. These 
studies have revealed that such characteristics at the time of matriculation such as being older'^ 
being female'^ having lower MCAT scores'"*, having lower science GPAs'^ being involved in 
volunteerism'^, having few research experiences'^, and having non-physician parents all were 
related to subsequent career choice. Little is known about the multivariable relationship between 
these characteristics and career choice. In addition, it is not known how members of admissions 
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committees use the information from these studies to assess the likelihood an applicant will 
ultimately choose a primary care career. 

The purpose of this study was first, to determine the multivariable relationship between the 
characteristics of applicants to the University of Virginia School of Medicine and their career 
choice at graduation, and second, to determine the multivariable relationship between the 
characteristics of these applicants and admissions committee members’ predictions of the 
likelihood that these applicants would choose a primary care career upon graduation from 
medical school. 

The specific research questions addressed in this study were as follows: 1) What is the 
multivariable relationship between applicant characteristics at the time of the interview and their 
career choice upon graduation from medical school, and 2) what is the multivariable relationship 
between applicant characteristics at the time of the interview and interviewers’ prediction of 
student career choice at graduation? 



Methods 

Sources of data 

First, thirteen variables that described the characteristics of applicants who ultimately became 
a member of the entering class of 1990, 1991, 1992, or 1993 were obtained from student records. 
These thirteen characteristics, or prediction variables, included quantitative and qualitative 
variables such as sex, age, MCAT scores, gpa, rural/nonrural status, level of service involvement, 
research experience, parents’ education, and parents’ occupations. (Table 1) Each of these 
variables had been associated with those medical school applicants who are more or less likely to 
enter primary care specialties in prior studies. 

The quantitative variables, such as age, MCAT scores, and college major were obtained from 
the American Medical College Application Service (AMCAS) student profile sheet in each 
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student record. The legal residence rural/nonrural status was assigned by AMCAS, with the 
rural designation based on Standard Metropolitan Statistical Areas with a population of less than 
50,000 people. College major was recoded as a “science” and “non-science” dichotomous 
variable, and race and parents’ occupations were constructed as categorical variables. The 
parents’ education variable was constructed by assigning a score for each parents’ level of 
education and summing the two scores according to the following scoring system: 1 = high 
school degree or below; 2 = bachelors degree or below; 3 = masters degree; 4 = postgraduate 
degree. 

The qualitative variables, which were level of service involvement and research related 
activities, were obtained from the AMCAS application utilizing a specific coding scheme for each 
variable based on specific decision rules. The level of service involvement for each student was 
determined by following the decision rules and coding methodology from a previous study. The 
decision rules for research related activities were developed with another faculty research 
member. Fifty-nine randomly selected applications were coded by the researcher and the faculty 
research member utilizing the decision rules for each of these qualitative variables, and Cohen s 
weighted kappa was utilized to measure the level of agreement. 

Second, thirteen members of the 1997-1998 admissions committee volunteered to 
review 35 to 45 one-page individual summaries of the prediction variables (e.g., age, 
college major, MCAT scores) collected on each applicant who ultimately became a 
member of the entering class of 1990, 1991, 1992, or 1993 and who subsequently 
graduated in 1994, 1995, 1996, and 1997. Upon reviewing each summary page, the 
admissions committee member made a prediction regarding the likelihood of that 
individual pursuing a primary care career upon graduation from medical school by giving 
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a percentage score that ranged from 0-100% (0% least likely, 100% most likely). 

Therefore, each graduate received one career prediction percentage score. 

Third, the career choices were obtained during the spring of the students’ fourth year using a 
career choice survey administered just prior to graduation from medical school. The survey was 
constructed to yield data regarding the students’ top three career choices and their degree of 
certainty about each choice. There was a 100% return rate for each of the four classes of students. 

This career choice survey was given only to those students entering the generalist residency 
programs of family medicine, internal medicine, and pediatrics. This refinement of the residency 
matching data (NRMP) was necessary to determine which of these graduates were oriented 
towards a primary care or a specialist career. Students were classified as pursing or not pursing a 
generalist career based on their first career choice given on this survey. All other students 
entering other residency programs were considered as pursing a subspecialty career. 

Analysis of Data 

The interviewers’ career prediction percentages were recoded as a dichotomous variable 
(0% - 50%, not likely to enter a generalist career; 51 - 100%, likely to enter a generalist career). 
Results obtained from the multiple linear regression model provided the rationale for the recoding 
cut points. Logistic regression then was utilized to describe the empirical relationships between 
applicants’ characteristics and student career choices at graduation, as well as applicants’ 
characteristics and interviewers’ predictions. An alpha level of .05 was set for the significance 
level. 

Results 

Five hundred and nine out of 520 graduates (n=509) were retained in the study. Eleven were 
missing career outcome data and thus removed from the study. One hundred and eighty-six 
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